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STATEMENT OF FOCUS 



The Wisconsin Research and Development Center for Cognitive Learning 
focuses' on contributing to a better understanding of cognitive learning by 
children and youth and to the improvement of related educational practices . 

T e strategy fof research and development is comprehensive. It includes 
basic research to generate new knowledge abput the conditions and processes 
of learning and about the processes of instruction, and the subsequent develop- 
ment of research-based instructional materials, many of which are designed for 
use by teachers and others for use by students . These materials are tested and 
refined in school settings. Throughout these operations behavioral scientists 
curriculum experts, academic scholars, and school people interact, insuring ’ 
that the results of Center activiUes are based soundly on knowledge of subject 

matter and cognitive learning and that they are applied to the improvement of 
educational practice. 

This Technical Report is from the Concepts In Verbal Argument Project in 
mgram 2. General objectives of the Program are: to establish, rationale and 
strategy for developing instructional systems, to identify sequences of con- 
cepts and cognitive skills, to develop assessment procedures for those con- 
cepts and skills, to identify or develop instructional materials associated with 
the concepts and cognitive skills, and to generate new knowledge about in- 
s^ctional procedures. Contributing to these Program objectives, the staff of 
the project developed a semiprogramed course in verbal argument and related 
tests for use at the high school level. The project staff prepared the materials 
on the basis of an outline of concepts and critical skills developed from an 
evaluation of everyday discourse. 



iii 









CONTENTS 



List of Tables 

Abstract 

I Introduction 

II Procedures 

Measurement Instrument 
Subjects 

Administration of WISTTRA Battery 
Treatment of Data 

III Results and Discussion 

Reliability Estimates 
Differences of Means 
Intercorrelations of WISTTRA 

Correlations of WISTTRA with Intelligence and Reading 

IV Conclusions 
Appendix 
References 
Footnote 



Page 

vii 

ix 

1 

3 

3 

4 

5 
5 - 

7 

7 

7 

8 
8 

15 

17 

27 

27 



O 

: ERIC 






LIST OF TABLES 
in Text 




Table 

1 Testing Orders 

2 Difference Between Means of Adjacent Grades 

3 Intercorrelations of WISTTRA for Grade 7 Males and Females 

4 Intercorrelations of WISTTRA for Grade 8 Males and Females 

5 Intercorrelations of WISTTRA for Grade 9 Males and Females 

6 Intercoirelations of WISTTRA for Grade 10 Males and Females 

7 Intercorrelations of WISTTRA for Grade 11 Males and Females 

8 Intercorrelations of WISTTRA for Grade 1 2 Males and Females 

9 Intercorrelations of Intelligence and Reading with Testimony • 
and Reasoning for Grades 7-12, Cedarburg 

10 Intercorrelations of Intelligence and Reading with Testimony 

and Reasoning for Grades 7-12, Reedsburg 



Page 

5 

7 

8 
9 
9 

10 

10 

11 

11 

12 



vii 



ERIC. 






LIST OF TABLES 
In Appendix 



Table 






Page 


A 


Testimony 


I: Reliability Estimates for* the Total Test 


19 


B 


Testimony 


I: Reliability Estimates for the Accept Subtest 


19 


C 


Testimony 


I: Reliability Estimates for the Bias Subtest 


20 


D 


Testimony 


I: Reliability Estimates for the Position Subtest 


20 


E 


Testimony 


I: Reliability Estimates for the Competence Subtest 


21 


F 


Testimony 


I: Reliability Estimates for the Qualification Subtest 


21 


G 


Testimony 

Unit 


I: Reliability Estimates for the Reject Subtests as a 


22 


H 


Testimony 


II: Reliability Estimates 


22 


I 


Testimony 


III: Reliability Estimates for the Total Test 


23 


J 


Testimony 


III: Reliability Estimates for the Recency Subtest 


23 


K 


Testimony 


III: Reliability Estimates for the Proximity Subtest 


24 


L 


Reasoning 


I: Reliability Estimates 


24 


M 


Reasoning 


II: Reliability Estimates 


25 


N 


Reasoning 


III: Reliability Estimates 


25 


0 


Reasoning 


IV: Reliability Estimates 


26 



viii 



ABSTRACT 



The normative study reported herein was conducted during the 1968 spring 
semester in the junior and senior high schools of Clinton, Cedarburg, Reeds- 
burg, and Owen-Withee, Wisconsin. A battery of seven tests, known collec- 
tively as the Wisconsin Tests of Testimony and Reasoning Assessment 
(WISTTRA), was administered to more than 3000 participating subjects. 

Inspection of the data seems to warrant the following conclusions! mean 
scores tend to increase gradually from Grade 7 through Grade 12; (the greatest 
change in mean scores between adjacent grades occurs between Grades 9 and 
10) thus. Grade 10 may be an optimum time to teach the abilities necessary 
for verbal argument; male students appear to acquire the abilities tested a 
little later in life than do females; and correlations of student scores on the 
verbal argument tests with student scores on intelligence and reading tests 
tend to be low to moderate. 



I 

INTRODUCTION 



The normative study reported in this paper 
constitutes one phase of the research and de- 
velopment activities conducted by the Concepts 
in Verbal Argument Project. This phase was pre- 
ceded by a review of relevant literature (Allen 
& Rott, 1969), the development of a taxonomy 
of concepts and critical abilities related to the 
evaluation of verbal argument (Allen, Feezel, 

& Kauffeld, 1967), the construction of a bat- 
tery of tests to measure student abilities in ’ 
assessing testimony and reasoning (Allen, 
Feezel, & Kauffeld, 1969), the testing and re- 
vision of the measuring instrument (Allen, 

Feezel, Kauffeld, & Harris, 1969), and a study 
of the dimensionality of the tests using factor- 
analytic procedures (Harris, 1969). 

Since the terminal goal of the project in- 
volves the making available of learning mate- 
rials in verbal argument for use by high school 
students, it was decided early in the project 
that data should be gathered regarding the crit- 
ical abilities of the general target population . 
Such data would provide a basis for determining 
at what grade level instruction in these con- 
cepts would seem most appropriate. was 



also intended that the normative data would 
guide the authors in the preparation of the 
learning program by offering precise informa- 
tion regarding pre-instructional student skills. 
Since the Wisconsin Tests of Testimony and 
Reasoning Assessment (WISTTRA) were devel- 
oped around the particular skills and their un- 
derlying conceptual structure of direct interest 
to the investigators, the data provided by the 
administration of the battery is highly specific 
and, therefore, directive. The learning pro- 
gram (Allen, Kauffeld, & O'Brien, 1968), field- 
tested during the 1969 Spring Semester (Allen, 
Fischbach, & Quilling, in press), was strongly 
influenced by the data gathered in the norma- 
tive study. 

In addition to its value to the project at 
large, the normative study may be found of in- 
terest in and of itself. In seeking to ascertain 
the ability of sutdents. Grades 7 through 12, 
to evaluate testimony and arguments estab- 
lished through reasoning, this study provides 
data of inters st to critical thinking researchers 
whatever their conceptual bias and to high 
school teachers in several academic disciplines. 




1 



li 

PROCEDURES 



In this section may be found a discussion 
of the measurement instrument for which norms 
were developed, the population from which the 
sample of subjects was drawn, administration 
procedures, and the method of analyzing and 
presenting the data. 



MEASUREMENT INSTRUMENT 

The Wisconsin Tests of Testimony and Rea- 
soning Assessment (WISTTRA) were developed 
by the researchers of the Concepts in Verbal 
Argument Project at the Wisconsin Research 
and Development Center for Cognitive Learning. 
WISTTRA was developed to assess the student's 
ability to evaluate adequacy of testimony, to’ 
recognize the structure that is present in ordi- 
nary arguments, and to raise pertinent objec- 
tions based on the rules of Inference appropri- 
ate to that structure. There are seven tests in 
the WISTTRA battery. The three tests of testi- 
mony were designed to measure the ability to 
detect instances of testimony which violate 
common internal and external tests . The four 
tests of reasoning were designed to measure 
the ability to recognize the essential parts of 
an argument, to ask relevant questions about 
arguments, and to draw appropriate conclusions 
from arguments. A thorough discussion of the 
development of the tests, including a statement 
of the objective for each test, a brief descrip- 
tion of each test, and reliability estimates and 
summary item statistics for each test, can be 
found in Allen, Fee zel, Kauffeld, and Harris 
(1969) . The tests proper are contained in Allen, 
Feezel, and Kauffeld (1969). The names of the 
tests are; Testimony I consisting of 1 Accept 
subtest and 4 Reject subtests — Bias, Position, 
Competence, and Qualification; Testimony II; 
Testimony Hi consisting of 2 subtests — Recency 
and Proximity; Reasoning I; Reasoning II; Rea- 
soning ill; and Reasoning IV. 1 

^See footnote on page 27. 



From two of the schools for which they were 
available, Cedarburg and Reedsburg, intelli- 
gence and reading scores were secured. The 
nature of these scores and the tests which were 
used to obtain them are as follows: 

Cedarburg; 

Grade 7: Intelligence scores are nonverbal 

raw scores from Lorqe-Thorndike 
Form 1. Level E . 

Reading scores are national percent- 
iles from Iowa Tests of Basic Skills , 
Form 2. 

Grade 8: Intelligence scores are verbal raw 

scores from Lorqe-Thorndike Form 
AA. Level 4 . 

Reading scores are the same as for 
Grade 7. ; 

Grades 

9^j Intelligence scores are raw scores 
from Henmon-Nelson Test of Mental 
Maturity . 

Reading scores are standard scores 
from Iowa Tests of Educational De- 
velopment. Reading .Average Section, 
Form XP-CP . 



Reedsburg: 

Grades 

7-8; Intelligence scores are I.Q. scores 
from the Henmon-Nelson Test of 
M ental Ability . " ‘ 

Reading scores are converted grade- 
placement scores from the Iowa Tests 
of Basic Skills . 

Grade 9: Intelligence scores are raw scores 

from the Henmon-Nelson Test of 
Mental Ability , 

Reading scores are raw scores from 
the Iowa Tests of Educational Devel- 
opment . 
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Grades 10-12: Intelligence scores are Henmon- 
Nelson raw scores. 

Reading scores are IT ED raw 
scores , 



SUBJECTS 

The researchers wished to obtain norms for 
the WISTTRA battery for boys and girls separately 
in Grades 7 through 12. The formula 

^ (1-g) - tolerance limit 

2 J/n 

was used to determine the size sample neces- 
sary to obtain a sample (estimated) mean that 
would be within a certain tolerance limit of the 
population (true) mean with a certain level of 
confidence. Using a standard deviation of 
seven (which is an approximate upper size for 
the tests being normed) and an alpha of .05, it 
was found that a sample size of approximately 
200 would be necessary for a tolerance limit of 
one unit. This is the sample size necessary for 
each sex and grade group since the data will be 
analyzed separately for each c’f the twelve 
groups . 

To obtain a homogeneous population from 
which to sample, Information obtained in a 
survey of Wisconsin school districts (Miller, 
et_al, , 1967) was used. This survey placed 
674 Wisconsin school districts into 32 strata 
on the basis of their factor scores on the fol- 
lowing six factors: 

1 . Numerical size 

2. Organizational complexity 

3. Teacher experience 

4. Economic power 

5 . Size of school unit 

6. Log variance of teacher credentials 

For stratification purposes, a school district 
was given a + or - for each of the six factors; 
a plus signified a factor score at or above the 
median and a minus a factor score below the 
median. 

The school districts liom two of these strata 
were used as the population for this normative 
study. These two strata were, + + + — + and 

+ + + , Thus the schools comprising the 

population were above the median in numerical 
size, organizational complexity, and teacher 
experience , A plus for Factor 4 , economic 
power, means that the district has a high val- . 
uatlon and such districts tend to be elementary 
only school districts; a minus was used for this 
factor, A plus for Factor 5, school unit size, 
means that the district has a large number of 
one- and two-room schools; a minus was used 



for this factor also. Since two of the strata 
were used, the one having a plus for Factor 6 
as well as the one having a minus for Factor 6, 
log variance of teacher credentials was not a 
factor characteristic of the population used, 

A total of 19 schools was included in the 
population. Of these, 13 are city and 6 are 
county school districts. Eighteen have Grades 
K-12; the one exception, which was not one of 
the sampled schools, has Grades 1-12, All are 
receiving state aid. On the average their sec- 
ondary enrollment is 1366,2 students, size of 
staff is 144,3, and on the average these dis- 
tricts have no one-room schools, ,15 two-room 
schools, and 7,1 schools of three or more 
rooms. Also the following statistics, by strata, 
may be of interest: 

+ + + — - ++ + — + 

Valuation 

per 

school $12,349,427,586 $10,563,546,789 

Valuation 

per 



student 


$27,259,355 


$23,358,352 


Students 

per 






school 


453.034 


452.239 


Students 






per 

staff 


22.969 


22.727 


Staff 






per 

school 


19.724 


19.899 



A random sample of six schools was drawn 
from the 19 schools comprising the population. 
These schools were then contacted, in the or- 
der in which they were sampled, and asked to 
participate in the study. Three of them agreed 
to do so. The total number of students in 
Grade 12 (Grade 12 was assumed to have the 
fewest and was used as the base) was not as 
many as the 400 we wanted — 200 boys and 200 
girls. Further random sampling was conducted 
and the school districts were contacted. The 
first additional district sampled was unable to 
participate but the second one did take part in 
the study. Thus the subjects for this study 
were from four school districts in the state of 
Wisconsin — Clinton, Cedarburg, Reedsburg, 
and Owen-Withee — with the characteristics 
previously explained. The size of the total 
sample was 3090 subjects to 3105 subjects de- 
pending upon the particular test. The smallest 
group in the sample was 190 Twelfth Grade 
males; all other groups contained well over 200 
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subjects. The exact number of subjects per 
group for each test can be found in Tables A 
through O, in the Appendix. 

ADMINISTRATION OF WISTTRA BATTERY 

The test battery consisting of the three tes- 
timony tests and four reasoning tests was ad- 
ministered during successive weeks in April 
1968 to students in Grades 7 through .12 in the 
following Wisconsin junior and senior high 
schools in the order indicated: Clinton, Ce- 
darburg, Reedsburg, and Owen -Wlthee. Each 
student was given as much time as needed to 
complete the tests . To minimize the fatigue 
factor, testing was conducted in two separate 
sessions on successive days, afternoon ses- 
sion followed by morning session. Testing 
time required for each session was from 2 to 
3 hours . There was great variation in the time 
required by students to complete the tests; how- 
ever, almost all students were able to finish 
either of the test sessions in less than 3 hours. 
It is estimated that the average completion time 
for the majority of students was about 2 1/2 
hours, with a substantial number finishing in 
about 2 hours and a few finishing in less than 
2 hours . 

The order of test taking was randomized, 
within certain tests allocated for a single ses- 
sion, across the four schools to cancel possi- 
ble learning effects of tests taken in their logi- 
cal order. Table 1 includes the testing orders 
for the testimony (T) and reasoning (R) tests for 
the two testing sessions in the four schools. 

The students responded to the tests by mark- 
ing their chosen answer directly on an answer 



sheet. Each student was given an envelope 
containing the printed test booklets and an- 
swer sheets for each session. The envelope 
was marked with the prescribed order in which 
the tests were to be taken. The test booklets 
were also arranged in this order. 

TREATMENT OF DATA 

Hoyt analysis of variance reliability esti- 
mates were obtained for each of the total tests 
and for subtests of Testimony I and Testimony 
III for each sex and grade group. The standard 
error of measurement was also computed for 
each of these. 

A summary of the item statistics for each 
test can be found in Allen, Feezel, Kauffeld, 
and Harris (1969). 

The mean and standard deviation were com- 
puted for each sex and grade group for each 
total test and for the subtests of Testimony I 
and Testimony IH. The difference between the 
means of adjacent grades was found, by sex, 
for each of the total tests. 

Intercorrelations of the seven tests in the 
WISTTRA battery were obtained. Included also 
were the intercorrelations of these seven tests 
with Testimony I as two subtests and with Tes- 
timony III as two siibtests . 

Intercorrelations of the seven tests in 
the WISTTRA battery with intelligence and 
reading scores were obtained for subjects 
from two of the schools, Cedarburg and 
Reedsburg . 

The next section will present the results 
obtained and a discussion of these results . 



Table 1 

Testing Orders 



School 


First Day 


Second Day 


1 . Clinton 


R-IV, R-I, R-III 


T-II, T-I, T-m, R-II 


2. Cedarburg 


R-III, R-I, R-IV 


T-I, T-II, T-III, R-II 


3. Reedsbrug 


T-III, R-II, T-I, T-II 


R-IV, R-III, R-I 


4, Owen-Withee 


T-II, T-I, R-II, T-III 


R-I, R-IV, R-III 
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RESULTS AND DISCUSSION 



In this section informetion will be presented 
regarding reliability estimates, differences of 
means of adjacent grades, intercorrelations of 
tests which comprise the WISTTRA battery, and 
correlations of W^STTRA with intelligence and 
reading. The reader is reminded that. a. descrip- 
tion of the tests can be found in Allen, Feezel, 
Kauffeld, and Harris (1969)'. 

RELIABILITY ESTIMATES 

Tables A through O in the Appendix contain 
the reliabiUty estimates, standard errors of 
measurement, means, and standard deviations 
for each sex and grade group for each of the ' 
total tests, for each of the subtests of Testi- 
mony I and Testimony III, and for the four re- 
ject subtests of Testimony I as a unit. 

The reliability estimates for the total tests, 
in general, gradually increase in magnitude from 



% 

Grade 7 toough Grade 12. For Grades 7 through 
9. the estimates tend to be in the .70s to low 
. 80s . For Grades 10 through 12 they tend to be 
in the .80s to low .90s. These reliability esti- 
mates are adequate for research purposes and 
for assessing level of group achievement; some 
of the reliabilities are adequate for assessing 
level of individual achievement. The reliability 
estimates are very similar at a t^articular grade 
level for the two sexes . 



DIFFERENCES OF MEANS 

The mean scores tend to increase gradually 
from Grade 7 through Grade 12 with the standard 
deviation remaining fairly similar in most cases. 
Table 2 contains the differences, by sex, be- 
tween the mean scores for adjacent grades. 
With three exceptions, the magnitude of the dif- 
ferences between the means of adjacent grades 



Table 2 

Difference Between Means of Adjacent Grades 



and Sex 


T-I 


T-II 


T-III 


.R-I 


R-II 


R-III 


R-IV 


7M-8M 

7F-8F 


1.8864 

1.9103 


-0.4671* 

0,3918 


0.4502 

1.6973 


0.1722 

1.8213 


1.8146 

1.0121 


1.4503 

1.9500 


1.6687 

1.5331 


8M-9M 

8F-9F 


. 1.2160 
1.3447 


0.0822 
. 0.1009 


0.3597 

0.4243 


0. 2625 
0.8256 


0.2423 • 
1.3030 


0.7719 

0.8479 


0.5428 

0.8835 


} 9M-10M. 
j 9F-10F 


2.6967 

2.3179 


0.5742 
1.8775 ■ 


1.8854 

1.3793 


3.2198 

2.8616 


0.8819 

1.4427 


2.8862 

2.3748 


2.1191 

1.9,074 


lOM-llM 

lOF-llF 


1.7572 

-0.1482* 


1.2772 

-0.3127* 


1.0434 

1.3041 


1.1849 

0.7349 


1.9267 

0.4994 


1.1381 

0.3830 


0.5144 

0.4354 


11M-12M 
IIF— 12F 


-0.4717* 

0.9155 


-0.0836* 

0.1578 


-0.5076* 

-0.6735* 


-0.2216* 

0.4913 


0.2119 

0.4082 


-0.6570*- 

1.0654 


-0.1962* 

0.9960, 



from one grade to the next decreases . 



the mean score 



is the greatest for any one test between Grades 
9 and 10. For males the magnitude of the dif- 
ference is the greatest between Grades 10 and 
11 for Testimony II and Reasoning II. The one 
exception for females occurs for Testimony III; 
the difference is the greatest between Grades 
7 and 8. These two exceptions for males and 
the fact that the differences between Grades 10 
and 1 1 tend to be higher for males than for fe- 
males are indications that male students may 
acquire the abilities tested a little later in life 
than do females. From looking at the total pat- 
tern of mean differences between adjacent grades 
it seems that 10th Grade may be a good time to 
teach these types of verbal argument skills. 
During this period students are gaining the most 
in these skills without instruction and thus, it 
may be the best time to supplement this natural 
learning with instruction. 



INTERCORRELATIONS OF WISTTRA 

The intercorrelations of the various tests in- 
cluded in the WISTTRA battery are given in Ta- 
bles 3 through 7 for males and females in Grades 
7 through 12. 

The three testimony tests and four reasoning 
tests were constructed so that each was com- 
posed of at least two subtests. The study of 
the dimensionality of the tests indicates that 



the four reject subtests of Testimony I (Bias, 
Position, Competence, and Qualification) are 
a separate dimension and that Testimony III 
consists of two different dimensions , Recency 
and Proximity (Harris , 1969). Thus, these ta- 
bles include the intercorrelations of Testimony 
I; Testimony II; Testimony III; Reasoning I; 
Reasoning II; Reasoning III; Reasoning IV; Tes- 
timony!, Accept; Testimony I, Reject; Testi- 
mony HI, Recency; and Testimony III, Proximity. 

The correlations, in general, are low to mod- 
erate indicating that these separate tests in the 
WISTTRA battery are measuring at least some- 
what different abilities . The fairly high correla- 
tions that appear are ones that would be expected 
to be high — for TI-Accept and TI-Reject with TI, 
and for TIII-Recency and Tlll-Proximity with Till 
— since one is correlating a part of the test with 
the total test of which it is a part. 



CORRELATIONS OF WISTTRA WITH 
INTELLIGENCE AND READING 

The correlations of the three tests of testi- 
mony and the four tests of reasoning with intel- 
ligence and reading scores are given in Table 
9 for Cedarburg and Table 10 for Reedsburg. In- 
telligence and reading scores were not available 
for the other two communities tested . The par- 
ticular tests used to obtain the intelligence and 



Table 3 

Intercorrelations of V/ISTTRA for Grade 7 Males and Females* 
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Table 4 

Intercorrelations of WISTTRA for Grade 8 Males and Females* 




Table 5 

Intercorrelations of WISTTRA for Grade 9 Males and Females* 




er|c 
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Table 6 



Intercorrelations of WISTTRA for Grade 10 Males and Females* 




Table 7 

Intercorrelations of WISTTRA for Grade 11 Males and Females* 




O 
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Table 8 



Intercorrelations of WISTTRA for Grade 12 Males and Females* 




Table 9 

Intercorrelations of Intelligence and Reading with 
Testimony and Reasoning for Grades 7-12, Cedarburg 





Int. 


Rdg. 


T-I T-II 


T-III 


R-I 


R-II R-III R-IV 




N (range) 


Grade 7M 


1.000 


.668 


.583 .500 


.537 


.418 


.470 .600 .550 


Intelligence 


65-79 






1.000 


.672 .655 


.579 


.451 


.521 .759 .658 


, Reading 




7F 


1.000 


.494 


.465 .444 


.342 


.549 


.472 .560 .574 


Intelligence 


64-77 






1.000 


.585 .677 


.532 


.688 


.726 .799 ,694 


Reading 


• 


Grade 8M 


1.000 


.808 


.655 .497 


.558 


.695 


.707 .704 .754 


Intelligence 


51-59 






1.000 


.771 .591 


.624 


.677 


.702' .786 .792 


Reading 




8F 


i.OOO 


.791 


.451 .624 


.507 


.757 


.708 .810 .808 


Intelligence 


53-65 






1.000 


.502 .504 


.494 


.609 


.695 .747 .651 


Reading 




Grade 9M 


1.000 


.749 


.683 .550 


.416 


.476 


.500 .648 .604 


Intelligence 


96-98 






1.000 


.613 .571 


.502 


.579 


.628 .669 .689 


Reading 




9F 


1.000 


.735 


.587 .553 


.561 


.571 


.614 .684 -.723 


Intelligence 


87-89 






1.000 


.556 ’.634 


.536 


.666 


.731 .720 .772 


Reading 




Grade lOM 


1.000 


.670 


.568 .569 


.549 


.585 


.550 .530 .483 


Intelligence 


90-91 






1.000 


.496 .678 


.661 


.727 


.672 .695 .679 


Reading 




lOF 


1.000 


.785 


.522 .580 


.450 


.688 


.683 .710 .656 


Intelligence 


95-98 






1.000 


.508 .653 


.363 


.718 


.668 .692 .664 


Reading 




Grade IIM 


1.000 


.835 


.413 .610 


.548 


.582 


.632 .611 .599 


Intelligence 


85-87 






1.000 


.521 .658 


.647 


.699 


.726 .686 .670 


Reading 




IIF 


1.000 


.824 


.547 .553 


.482 


.737 


.667 .719 .640 


Intelligence 


78-78 






1.000 


.517 .560 


.597 


.750 


.745 .732 .749 


Reading 




Grade 12M 


1.000 


,665 


.417 .410 


.510 


.562 


.469 .683 .566 


Intelligence 


57-61 






1.000 


.423 .474 


.562 


.604 


.524 .619 .609 


Reading 




12F 


1.000 


.843 


.463 .406 


.426 


.581 


.624 .613 .643 


Intelligence 


90-93 






1.000 


.495 .517 


.455 


.654 


.682 .645 .735" 


Reading 








n 



Table 10 



Intercorrelations of Intelligence and Reading with 
Testimony and Reasoning for Grades 7-12, Reedsburg 





Int. 


Rdg. 


T-I 


T-II T-III 


R-I R-II R-III R-IV 




N (range) 


Grade 7M 


1.000 


.774 


.586 


.459 .398 


.554 .591 .573 .562 


Intelligence 


77-77 






1.000 


.664 


.550 .427 


.724 .567 .714 .685 


Reading 




7F 


1.000 


.663 


.344 


.299 .333 


.359 .386 .598 .488 


Intelligence 


72-74 






1.000 


.512 


.391 .415 


.310 .493 .641 .655 


Reading 




Grade 8M 


1.000 


.814 


.520 


.389 .258 


.492 .553 .664 .650 


Intelligence 


75-79 






1.000 


.602 


.474 .361 


.533 .669 .731 .684 


Reading 




8F 


1.000 


.826 


.592 


.379 .387 


.688 .702 .629 .637 


Intelligence 


66-68 






i.OOO 


.652 


.444 .375 


.685 .718 .699 .742 


Reading 




Grade 9M 


1.000 


.695 


.486 


.460 .291 


.561 .496 .630 .644 


Intelligence 


97-99 






1.000 


.592 


.443 .298 


.517 .602 .696 .675 


Reading 




9F 


1.000 


.794 


.571 


.648 .454 


.606 .687 .724 .701 


Intelligence 


109-113 






1.000 


.676 


.675 .492 


.722 .686 .804 .739 


Reading 




Grade lOM 


1.000 


.798 


.565 


.338 .344 


.526 .560 .667 .618 


Intelligence 


54-82 






1.000 


.670 


.355 .366 


.582 .607 .754 .661 


Reading 




lOF 


1.000 


.862 


.520 


.481 .343 


.603 .711 .720 .656 


Intelligence 


52-79 






1.000 


.469 


.504 .327 


.595 .650 .663 .625 


Reading 




Grade IIM 


1.000 


.715 


.689 


.464 .485 


.539 .502 635 .570 


Intelligence 


85-90 






1.000 


.653 


.504 .572 


.608 .630 .727 .677 


Reading 




IIF 


1.000 


.732 


.516 


.513 .420 


.616 .624 .617 .658 


Intelligence 


91-92 






1.000 


.580 


.551 .406 


.660 .714 .679 .701 


Reading 




Grade 12M 


1.000 


.816 


.643 


.532 .603 


.605 .612 .616 .693 


Intelligence 


66-69 






1.000 


.776 


.599 .639 


.751 .749 .763 .803 


Reading 




12F 


1.000 


.793 


.648 


.492 .430 


.640 .584 .736 .530 


Intelligence 


74-78 






1.000 


.640 


.478 .473 


.693 .696 .755 .537 


Reading 





reading scores are listed in the previous sec- 
tion of this paper. The number of subjects is 
given for each group, the range being over the 
seven tests of verbal argument. 

The intercorrelations of reading and intel- 
ligence are, in most cases, higher than the 
intercorrelations of reading or intelligence 
with the testimony and reasoning tests . Cor- 
relations between intelligence and reading tend 
to be fairly high while the correlations of the 
verbal argument tests with intelligence and ‘ 
reading tend to be low to moderate in magni- 
tude. From this it would appear that the tests 
in the WISTTRA battery are measuring something 
different from the abilities measured by the 
intelligence and reading tests . It should be 
noted at this point that in the development of 
the tests. Grade 9 was selected as the maxi- 
mum difficulty level of the vocabulary used. 

The difficulty levels indicated in Thorndike 
arid Lorge (1944) were used as a guide. 

In comparing the correlations of the testi- 
mony tests with intelligence and reading, and 
the correlations of the reasoning tests with 



intelligence and reading (comparison by col- 
umns), it appears that the tests of reasoning 
tend to correlate more highly with intelligence 
and reading than do the tests of testimony, ex- 
cept for Seventh Grade males at Cedarburg. 

This higher correlation of the reasoning tests 
with the intelligence measures may indicate 
that the evaluation of reasoning is more de- 
pendent upon an Individual's basic mental 
capacity than are the skills for assessing in- 
stances of testimony. The differences in the 
correlations with reading ability may suggest 
a similar dependence upon reading skills or 
may be merely a function of the longer test 
items with several interrelated sentences which 
compose the reasoning tests. 

In comparing the correlations of the testi- 
mony and reasoning tests with intelligence, 
and the correlations of the testimony and rea- 
soning tests with reading (comparison by rows) , 
it appears that for any one grade level the testi- 
mony and reasoning tests tend to correlate more 
highly with reading than with intelligence , ex- 
cept for the Eighth Grade females at Cedarburg 



12 



and the Tenth Grade females at Reedsburg . 
Perhaps this trend reflects that the evaluation 
of arguments couched in ordinary language re- 
lies upon the analysis of that language and is, 
therefore, more related to verbal abilities than 
to a general intellectual ability. Supportive of 



this hypothesis is that for one of the excep- 
tions to the trend. Eighth Grade females at 
Cedarburg for which the tests are more highly 
correlated with intelligence than with reading, 
the intelligence measure was the verbal por- 
tion only from a standard intelligence test. 
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CONCLUSIONS 



The reliability estimates for each of the 
seven tests in the WISTTRA battery are fairly 
high. They are substantially higher for Grades 
10 through 12, the levels for which the tests 
were primarily designed, than they are for 
Grades 7 through 9, The reliability estimates 
are high enough to warrant assessing levels 
of group achievement for all grades, 7 through 
12, The reliability estimates for Grades 10 
through 1 2 approach desirable levels for as- 
sessing individual achievement. Care should 
be exercised in comparing the scores of in- 
dividual students when the reliability estimate 
is below ,90; thus, this should not be done 
for Grades 7 through . 9 and done with cau- 
tion for most of the tests for Grades 10 
through 12, 

The mean scores tend to increase gradually 
from Grade 7 through Grade 12, The greatest 



change in mean scores between aCjacent grades 
occurred, almost always, between Grades 9 
and 10. Since the tests were administered in 
April for this normative study, it would seem 
that the factors, whatever they may be, that 
are responsible for the changes in verbal argu- 
ment abilities are operating with maximum ef- 
fect after Grade 9 and during Grade 10, Grade 
10, therefore, may be a good time to teach 
these verbal argument abilities. 

Males tend to acquire the abilities tested a 
little later in life than do females , 

The intercorrelations of the WISTTRA battery, 
in general, are low to moderate indicating that 
these separate tests are measuring at least 
somewhat different abilities , It appears that 
the tests in the WISTTRA battery are measuring 
something different from the abilities measured 
by the intelligence and reading tests , 



APPENDIX 



Table A 

Testimony I: Reliability Estimates for the Total Test 



Grade/Sex 


N 


Mean Score 
(60 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Error of 
Measurement 


Hoyt 

Reliability 


7M 


246 


37.89 


7.44 


18-58 


3.48 


.78 


7F 


251 


38.96 


6.62 


12-56 


3.42 


.73 


8M 


228 


39.78 


7.85 


24-54 


3.38 


.81 


8F 


224 


40.87 


7.06 


25-55 


3.29 


.78 


9M 


304 


41.00 


8.04 


13-56 


3.29 


.83 


9F 


302 


42.22 


7.23 


25-57 


3.19 


.80 


lOM 


287 


43.69 


8.04 


6-58 


3.08 


.85 


lOF 


302 


44.53 


6.70 


23-57 


2.97 


.80 


IIM 


253 


45.45 


6.84 


23-57 


2.92 


.81 


IIF 


265 


44.38 


6.45 


16-56 


2.96 


.79 


12M 


190 


44.98 


8.09 


22-59 


2.97 


.86 


12F 


253 


45.30 


6.73 


12-57 


2.88 


.81 



Table B 

Testimony I: Reliability Estimates for the Accept Subtest 


Grade/Sex 


N . 


Mean Score 
(20 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Error or 
Measurement 


Hoyt 

Reliability 


7M 


246 


14.22 


3.90 


0-20 


1.80 


.7-8 


7F 


251 


15.00 


3.23 


5-20 


1.75 


.69 


,8M 


228 


15.00 


3.50 


7-20 


1.74 


.74 


8F 


224 


15.65 


3.16 


7-20 


1.64 


.72 


9M 


304 


15.42 


3.57 


6-20 


1.66 


.77 


9F 


302 


16.19 


3.05 


5-20 


1.54 


.73 


lOM 


287 


16.43 


3.46 


7-20 


1.47 


.80 


lOF 


302 


17.14 


2.48 


8-20 


1.37 


.68 


IIM 


253 


17.50 


2.61 


7-20 


1.31 


.74 


IIF 


265 


17.38 


2.53 


6-20 


1.31 


.72 


12M 


190 


17.14 


3.21 


7-20 


1.37 


.81 


12F 


253 


17.68 


2.41 


4-20 


1.23 


.72 
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Table C 

Testimony I: Reliability Estimates for the Bias Subtest 



Grade/Sex 


N 


Mean Score 
(10 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Error of 
Measurement 


Hoyt 

Reliability 


7M 


246 


5.16 


2.17 


0-9 


1.32 


.59 


7F 


251 


5.19 


2.14 


1-10 


1.29 


.60 


8M 


228 


5.48 


2.05 


0-10 


1.34 


.53 


8F- 


224 


5.38 


2.28 


0-10 


1.26 


. 1.6 


9M 


304 


5.53 


2.15 


0-10 


1.33 


.57 


9F 


302 


5.49' 


2.12 


0-10 


1.‘27 


.60 


lOM 


287 


5.86 


2.13 


0-10 


1.27 


.61 


lOF 


302 


5.57 


2.20 


1-10 


1.21 


.66 


IIM 


253 


6.00 


2.21 


1-10 


1.21 


.67 


IIF 


265 


5.62 


2.19 


0-10 


1.20 


.67 


12M 


190 


5.91 


2.15 


0-10 


1.26 


.61 


12F 


253 


5.74 


2.31 


0-10 


1.19 


.70 



Table D 

Testimony I; Reliability Estimates for the Position Subtest 


Grade/Sex 


N 


Mean Score 
(10 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Error of 
Measurement 


Hoyt 

Reliability 


7M 


246 


5.65 


1.91 


0-10 


1.41 


.39 


7F 


. 251 


5.59 


2.00 


1-10 


1.40 


.46 


8M 


228 


5.91 


1.92 


0-10 


1.40 


.41 


8F 


224 


5.91 


1.90 


1-10 


1.37 


.43 


9M 


304 


6.19 


1.88 


2-10 


1.36 


.42 


9F 


302 


6.36 


■ 2.09 


0-10 


1.32 


.56 


lOM 


287 


6.50 


1.96 


1-10 


1.30 


.51 


lOF 


302 


6.66 


1.90 


1-10 


1.27 


.50 


IIM . 


253 


6.47 


1.92 


1-10 


1.29 


.50 


IIF 


265 


6.42 


1.93 


2-10 


1.28 


.51 


12M 


190 


6.54 


2.08 


1-10 


1.26 


.59 


12F 


253 


6.67 


2.03 


1-10 


1.22 


.6a 
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Table E 

Testimony I: Reliability Estimates for the Competence Subtest 



Grade/Sex 


N 


Mean Score 
(10 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Error of 
Measurement 


Hoyt 

Reliability 


7M 


246 


6.55 


2.03 


1-10 


1.34 


.52 


7F 


251 


6.34 


2.11 


1-10 


1.35 


.55 


8M 


228 


6.75 


2.01 


2-10 


1.32 


.52 


8F 


224 


6.88 


2.07 


1-10 


1.29 


.57 


9M 


304 


6.94 


2.04 


2-10 


1.28 


.57 


9F 


302 


6.88 


2.18 


1-10 


1.26 


.63 


lOM 


287 


7.45 


2.01 


2-10 


1.20 


.60 


lOF 


302 


7.30 


2.13 


2-10 


1.19 


,65 


IIM 


253 


7.63 


1.89 


2-10 


1.16 


.58 


IIF 


265 


7.09 


2.10 


2-10 


1.22 


.62 


12M 


190 


7.55 


1.96 


1-10 


1.18 


.60 


12F 


253 


7.32 


1.97 


2-10 


1.20 


.58 



Table F 

Testimony I: Reliability Estimates for the Qualification Subtest 












Standard 








Mean Score 


Standard 


Spread 


Error of 


Hoyt 


Grade/Sex 


N 


(10 max.) 


Deviation 


of Scores 


Measurement 


Reliability 


7M 


246 


6.31 


2.01 


0-10 


1.37 


.48 


7F 


251 


6.84 


1.75 


2-10 


1.33 


.36 


8M 


228 


6.65 


2.02 


2-10 


1.32 


.52 


8F 


224 


7.05 


1.97 


3-10 


1.28 


.53 


9M 


30^. 


6.91 


1.98 


2-10 


1.28 


.53 


9F 


302 


7.30 


1.90 


2-10 


1.24 


.53 


lOM 


287 


7.45 


1.92 


2-10 


1.21 


.56 


lOF 


302 


7.88 


1.73 


3-10 


1.12 


.53 


IIM 


253 


7.86 


1.67 


3-10 


1.14 


.48 


IIF 


265 


7.89 


1.72 


3-10 


1.13 


.52 


12M 


190 


7,85 


1.91 


3-10 


1.12 


.61 


12F 


253 


7.88 


1.72 


2-10 


1.12 


.53 
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Table G 



Testimony I: Reliability Estimates for 
the Four Reject Subtests as a Unit 



Grade/Sex 


N 


Mean Score 
(40 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Error of 
Measurement 


Hoyt 

Reliability 


7M 


246 


22.44 


5.03 


7-37 


2.88 


0.66 


7F 


246 


22.62 


4.83 


5-35 


2.85 


0.64 


8M 


227 


23.37 


4.80 


12-33 


2.85 


0.64 


8F 


224 


23.57 


5.00 


8-35 


2.76 


0.69 


9M 


304 


23.89 


5.08 


8-38 


2.78 


0.69 


9F 


302 


24.09 


5.37 


7-37 


2.69 


0.74 


lOM 


287 


25.14 


4.96 


5-36 


2.6'’ 


0.71 


lOF 


302 


24.99 


5.04 


7-36 


2.54 


0.74 


IIM 


253 


25.49 


4.78 


13-35 


2.52 


0.72 


IIF 


265 


24.26 


5.50 


4-35 


2.54 


0.78 


12M 


190 


25.49 


5.24 


10-36 


2.56 


0.76 


12F 


252 


25.0] 


5.31 


6-36 


2.47 


0.78 



Table H 

Testimony II: Reliability Estimates 


Grade/Sex 


N 


Mean Score 
(20 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Error of 
Measurement 


Hoyt 

Reliability 


7M 


246 


13.14 


3.83 


0-20 


1.93 


.73 


7F 


251 


12.77 


3.86 


4-20 


1.95 


.73 


8M 


228 


12.67 


4.32 


4-20 


1.92 


.79 


8F 


224 


13.16 


4.26 


6-20 


1.88 


.79 


9M 


304 


12.75 


4.36 


4-20 


1.91 


.80 


9F 


302 


13.26 


4.51 


4-20 


1.84 


.82 


lOM 


287 


13.33 


4.89 


2-20 


1.80 


.86 


lOF 


302 


15.14 


4.32 


5-20 


1.64 


.85 


IIM 


253 


14.60 


4.58 


0-20 


1.69 


.86 


IIF 


265 


14.83 


4.79 


3-20 


1.63 


.88 


12M 


190 


14.52 


4.76 


6-20 


1.68 


.87 


12F 


253 


14.98 


4.69 


0-20 


1.61 


.88 
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Table I 

Testimony III: Reliability Estimates for the Total Test 



Grade/Sex 


N 


Mean Score 
(40 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Error of 
Measurement 


Hoyt 

Reliability 


7M 


246 


23.59 


5.58 


12-37 


2.93 


.72 


7F 


251 


23.55 


5.33 


14-37 


2.90 


.70 


8M 


227 


24.04 


6.14 


5-40 


2.89 


.77 


8F 


223 


25.25 


5.29 


14-38 


2.80 


.71 


9M 


303 


24.40 


5.99 


11-38 


2.86 


.77 


9F 


305 


25.68 


5.72 


. 8-38 


2.77 


.76 


lOM 


228 


26.28 


6.54 


3-40 


2.73 


.82 


lOF 


311 


27.05 


, 5.83 


16-39 


2.65 


.79 


IIM 


256 


27.33 


6.66 


0-40 


2.64 


.84 


IIF 


262 


28.36 


6.07 


10-39 


2.55 


.82 


12M 


195 


26.82 


6.42 


13-39 


2.70 


.82 


12F 


251 


27.69 


6.33 


4-40 


2.56 


.83 



Table J 

Testimony III: Reliability Estimates for the Recency Subtest 


Grade/Sex 


N 


Mean Score 
(20 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Error of 
Measurement 


Hoyt 

Reliability 


7M 


246 


12.57 


3.32 


4-20 


2.0G 


.62 


7F 


251 


12.88 


3.42 


7-20 


1.97 


■ .65 


8M 


227 


12.73 


3.61 


6-20 


1.97 


.69 


8F 


223 


13.73 


3.44 


7-20 


1.86 


.69 


9M 


303 


12i91 


3.64 


5-20 


1.95 


.70 


9F 


305 


13.90 


3.36 


7-20 


1.85 


.68 


lOM 


288 


14.15 


3.64 


7-20 


1.83 


.73 


lOF 


311 


14.69 


3.21 


6-20 


1.75 


.71 


IIM 


256 


14.54 


3.70 


0-20 


1.76 


.76 


IIF 


262 


15.40 


3.28 


7-20 


1.66 


.73 


12M 


195 


14.30 


3.64 


6-20 


1.79 


.75 


12F 


251 


14.97 


3.25 


7-20 


1.69 


.72 
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Table K 

Testimony III: Reliability Estimates for the Proximity Subtest 



Grade/Sex 




Mean Score 
(20 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Error of 
Measxirement 


Hoyt 

Reliability 


7M 


246 


11.02 


3.22 


3-20 


2.06 


.57 


7F 


251 


10.67 


3.0/ 


4-19 


2.05 


.53 


8M 


227 


11.31 


3.53 


5-20 


2.03 


.65 


8F 


223 


11.52 


3.09 


4-19 


2.01 


.56 


9M 


303 


11.49 


3.40 


4-20 


2.02 


.63 


9F 


305 


11.78 


3.42 


2-19 


1.98 


.65 


lOM 


288 


12.13 


3.87 


1-20 


1.94 


.73 


lOF 


311 


12.63 


3.71 


2-20 


1.90 


.72 


IIM 


256 


12.79 


3.86 


0-20 


1.89 


.74 


IIF 


262 


12.96 


3.81 


4-20 


1.84 


.75 


12M 


195 


12.52 


3.64 


4-20 


1.94 


.70 


12F 


251 


12.72 


3.99 


4-20 


1.83 


.78 



Taole L 

Reasoning I: Reliability Estimates 


Grade/Sex 


N 


Mean Score 
(28 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Error of 
Measurement 


Hoyt 

Reliability 


7M 


245 


8.24 


5.00 


0-24 


2.18 


.80 


7F 


248 


8.97 


4.87 


0-25 


2.24 


.78 


8M 


230 


9.41 


5.58 


1-28 


2.23 


.83 


8F 


218 


10.79 


5.99 


3-27 


2.24 


.85 


9M 


302 


9.69 


5.77 


1-25 


2.23 


.84 


9F 


301 


11.61 


6.57 


1-27 


2.24 


.88 


lOM 


277 


12.90 


6.89 


1-28 


2.25 


.89 


lOF 


294 


14.48 


7.48 


2-28 


2.16 


.91 


IIM 


262 


14.08 


7.58 


1-28 


2.18 


.91 


IIF 


270 


15.21 


7.48 


1-28 


2.16 


.91 


12M 


191 


13.86 


7.84 


1-28 


2.16 


.92 


12F 


25 2 


15.70 


7.16 


3-28 


2.18 


.90 
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Table M 

Reasoning II: Reliability Estimates 







Grade/Sex 


N 


Mean Score 
(28 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Enror of 
Measurement 


Hoyt 

Reliability 


7M 


246 


15.94 


3.91 


. 7-26 


2.42 


.60 


7F 


251 


- 17. -24 


4.16 


9-27 


2.37 


.66 


8M 


227 


17.76 


4.40 


8-28 


2.38 


.70 


8F 


223 


18.25 


4.43 


9-27 


2.30 


.72 


9M 


303 


18.00 


4.87 


8-28 


2.32 


.76 


9F 


305 


19.55 


4.62 


7-28 


2.17 


.77 


lOM 


288 


18.88 


4.95 


6-27 


2.14 


.81 


lOF 


311 


21.00 


4.85 


9-28 


2.00 


.82 


IIM 


256 


20.81 


5.19 


0-28 


2.05 


.84 


IIF 


262 


21.50 


4.53 


9-28 


1.94 


.81 


12M 


195 


21.02 


5.15 


9-28 


2.03 


.84 


12F 


251 


21.90 


4.67 


5-28 


1.86 


.84 



Table N 

Reasoning III: Reliability Estimates 


Grade/Sex 


N 


Mean Score 
(28 max.) 


Standard 

Deviation 


Spread 
of Scores 


Standard 
Enror of 
Measurement 


Hoyt 

Reliability 


7M 


245 


12.44 


5.67 


3-27 


2.34 


.82 


7F 


248 


13.77 


5.24 


3-26 


2.35 


.80 


8M 


230 


13.89 


6.13 


3-28 


2.31 


.85 


8F 


218 


15.72 


5.89 


4-26 


2.27 


.85 


9M 


302 


14.66 


6.36 


3-26 


2.27 


.87 


9F 


301 


16.57 


5.92 


b-27 


2.24 


.85 


lOM 


277 


17.55 


6.22 


3-28 


2.18 


.87 


lOF 


294 


19.14 


5.42 


5-28 


2.10 


.84 


IIM 


262 


18.68 


6.25 


0-28 


2.11 


.88 


IIF 


270 


19.53 


5.63 


2-28 


2.06 


.86 


12M 


191 


18.03 


6.71 


4-28 


2.12 


.90 


12F 


252 


20.59 


4.94 


5-28 


2.00 


.83 
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Table O 

Reasoning IV: Reliability Estimates 



Standard 



Grade/Sex 


N 


Mean Score 
(28 max.) 


Standard 

Deviation 


Spread 
of Scores 


Error of 
Measurement 


Hoyt 

Reliability 


7M 


245 


14.39 


4.97 


4-27 


2.40 


.76 


7F 


248 


15.41 


4.73 


5-27 


2.39 


.74 


8M 


230 


16.06 


4.81 


5-25 


2.37 


.75 


8F 


218 


16.94 


4.86 


5-27 


2.33 


.76 


9M 


302 


16.60 


5.25 


4-27 


2.30 


.80 


9F 


301 


17.82 


5.09 


4-28 


2. 25 


.80 


lOM 


277 


18.72 


5.12 


. 5-28 


2.21 


.81 


lOF 


294 


19.73 


4.51 


6-28 


2.15 


.77 


IIM 


262 


19.23 


4.96 


3-28 


2.17 


.80 


IIF 


270 


20.17 


4.35 


6-28 


2.10 


.76 


12M 


191 


19.04 


5.63 


5-28 


2.14 


.85 


12F 


252 


21.16 


3.88 


10-28 


2.03 


.72 
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FOOTNOTE 



The names of the tests are; Testimony I — 
Appraising Testimony in Terms of Internal Cri- 
teria which consists of one Accept subtest and 
four Reject subtests (Bias, Position, Compe- 
tence, and Qualification); Testimony II — Ap- 
praising Testimony in Terms of External Criteria 
(Consistency with other Testimony); Testimony 



in — Appraising Testimony in Terms of External 
Criteria (Recency and Proximity); Reasoning I 
— Recognizing and Selecting Warrants in Argu- 
ments; Reasoning II— Recognizing Statements 
which Answer Reservations in Arguments; Rea- 
soning III — Selecting Reservations in Arguments; 
and Reasoning IV— Selecting Claims in Arguments. 



